The mismatch negativity (MMN) and the McGurk effect
نویسندگان
چکیده
The McGurk illusory percept is obtained by dubbing an incongruent articulatory movement onto an auditory signal. The Mismatch Negativity (MMN) of the auditory Event-Related Potential (ERP) reflects the detection of a deviant stimulus within auditory short-term memory (STM) and besides an acoustic component, possesses, under certain conditions, a phonetic one. The present study assessed the existence of an MMN evoked by McGurk percepts. Three experimental conditions were investigated: auditory alone, visual alone and audiovisual (all with the same auditory components). The auditory deviant syllables and the audiovisual incongruent syllables elicited a significant MMN. In the visual condition, no negativity was observed. An MMN can be evoked by audiovisual stimuli that are deviant by their visual content only, provided they are presented in a suitable auditory context leading to a phonetically significant interaction.
منابع مشابه
Face configuration affects speech perception: Evidence from a McGurk mismatch negativity study
We perceive identity, expression and speech from faces. While perception of identity and expression depends crucially on the configuration of facial features it is less clear whether this holds for visual speech perception. Facial configuration is poorly perceived for upside-down faces as demonstrated by the Thatcher illusion in which the orientation of the eyes and mouth with respect to the fa...
متن کاملPii: S1388-2457(02)00024-x
Objectives: The McGurk–MacDonald illusory percept is obtained by dubbing an incongruent articulatory movement on an auditory phoneme. This type of audiovisual speech perception contributes to the assessment of theories of speech perception. The mismatch negativity (MMN) reflects the detection of a deviant stimulus within the auditory short-term memory and besides an acoustic component, possesse...
متن کاملSeeing voices: High-density electrical mapping and source-analysis of the multisensory mismatch negativity evoked during the McGurk illusion.
Seeing a speaker's facial articulatory gestures powerfully affects speech perception, helping us overcome noisy acoustical environments. One particularly dramatic illustration of visual influences on speech perception is the "McGurk illusion", where dubbing an auditory phoneme onto video of an incongruent articulatory movement can often lead to illusory auditory percepts. This illusion is so st...
متن کاملVisual Processing Affects the Neural Basis of Auditory Discrimination
The interaction between auditory and visual speech streams is a seamless and surprisingly effective process. An intriguing example is the "McGurk effect": The acoustic syllable /ba/ presented simultaneously with a mouth articulating /ga/ is typically heard as /da/ [McGurk, H., & MacDonald, J. Hearing lips and seeing voices. Nature, 264, 746-748, 1976]. Previous studies have demonstrated the int...
متن کاملMismatch negativity and late discriminative negativity in sleeping human newborns.
Event-related potentials were recorded from sleeping newborns to compare amplitudes and latencies of mismatch negativity (MMN) and late discriminative negativity (LDN) in active and quiet sleep stages. MMN and LDN were obtained in response to changes in semi-synthesized vowels from 20 healthy newborn infants. MMN and LDN responses were significant for both active and quiet sleep. The amplitude ...
متن کامل